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[57] ABSTRACT 

In a pointing system for use in notifying an operator of a 
cursor position on a display without rdying on a sense of 
sight, information is derived in relation to an interactive item 
from a plurality of positions which arc adjacent to the cursor 
position. A tactile sense or an iimer force sense is determined 
by a rdationsh^ of the interactive items between the cursor 
position and the adjacent positions. The tactile sense may be 
displayed by a tactile display while the inner force sense, by 
a movable stage controllable by braking units. An absolute 
coordinate system may be used to indicate a position of the 
tactile display or the movable stage and is in one-to-one 
correspondence to a coordinate system of the di^lay. 

4 Claims, 8 Drawing Sheets 
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ADJACENT CURSOR SYSTEM WITH 
TACTILE FEEDBACK FOR THE BUND 

BACKGROUND OF THE INVENTION 

This invention relates to a pointing system for. use in 
pointing a coordinate position by manipulating a grai^cal 
user interface which is included in an interactive infonnation 
processing system, sudi as a personal conq)uter system. 

In generaL an interactive infonnation processing system 
of the type described has a graphical user interface which 
facilitates manipulation of the processing system. 
Spedfically, a plurality of interactive items are visually 
displayed together with a cursor on a screen of a display unit 
to specify operations to be selected by an operator. The 
<q)crator selects one erf the interactive items by the use of a 
pointing unit, such as a mouse, a ball to carry out a desired 
one of the operations. In this event, the <^)crator should 
adjust the cursor to a desired interactive item by moving the 
pointing unit, visually watching the cursor and the interac- 
tive items. Such visual adjustment of the cursor and the 
interactive items in^ses a burden on a sense of sight of the 
operator, as well known in the art. 

A wide variety of proposals have bctn offered so as to 
lighten the burden on the sense erf sight For example, a 
pointing system disclosed in J^anese Unexamined Patent 
Publication No. Hei 4-286015, namely. 286015/1992^ has a 
scheme which infonns an operator by a tactile sense of the 
fact that the cursor is entered within a predetermined range 
adjacent to one (rf the interactive items. 

Instead of the tactile sense, an inner force sense may be 
used to inform an operator of approach of the cursor to one 
of the interactive items, as mentioned in Japanese Unexam- 
ined Patent PubUcation No. Hd. 5-313820, namely. 30820/ 
1993. 

With both the above-mentioned structures, the operator 
initially visually watches the cursor and the interactive items 
to thereafter confirm the positions of the cursor and one of 
the interactive items and to determine a movement direction 
of the cursor. Thereafter, the operator may move the cursor 
along the movement direction until ^proacfa of the cursor to 
the selected interactive item is notified by the tactile sense or 
by the inner force sense. In this event, the operator may not 
gaze the cursor during the movement of the mouse Because 
a final position of the cursor is notified by the tactile sense 
CT by the iimer force sense. 

However, the cursOT may not be always conveniently 
moved along the direction initially determined, without 
gazing the cursor. This means that the cursor may be often 
located at a position of another interactive item different 
from the selected interactive item. Therefore, the operator 
should visually confirm whether or not the cursor is cor- 
rectly located on the selected interactive item. In addition, 
even when the cursor is correctly positioned on the selected 
interactive item, the operator can recognize neither a con- 
figuration of a zone assigned to the selected intmctive item 
nor a local position of the cursor in the zone. 

Furthermore, the pointing unit, such as the mouse, the 
ball, should be moved on a plane to indirectly indicate the 
position of the cursor. Specifically, a current position is 
determined by calculating a variation between the current 
position of the cursor and a previous position. This means 
that a relative position is determined on a relative coordinate 
of the plane along which the pointing unit is moved. 

Alternatively, another proposal has been directed to a 
pointing system which can move a cursor horizontally or 
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vertically, regardless of movement of a mouse, as disclosed 
Id Japanese Unexamined Patent Publication No. Hei 
1-260523, namely. 260523/1989. With this structure, inoo- 
inddence takes place between the movement of the cursor 
5 and ttic movement of the mouse. This makes control of both 
the mouse and the cursor difficult 

At any rate, each of the above-enumerated pointing sys- 
tems is never gentle for a person who has a handicap in the 
sense of sig^t 

For example, the handicapped person can not easily 
recognize the relative coordinate and can therefore fail to 
slrnifi illy manipulate the pointing unit In addition, the 
handicapped person can not know where the cursor is 
positioned even when selection of one of the interactive 
items is informed by tiie tactile sense or the inner force 
sense. This is because the tactUe sense or the inner force 
sense is invariable as long as the cursor is located in a zone 
assigned to each of the interactive items no matter where the 
cursor is positioned. 

20 

SUMMARY OF THE INVENTION 

It is an objea of this invention to provide a pointing 
system which is gentle and convenient for a handicapped 
25 person who has a handle^ in the sense of sight 

It is another object of this invention to provide a pointing 
system of the type described, which is enable of jH^ecisely 
notifying an operator of a position of a cursor even when the 
cursoa: is locked within a zone assigned to an interactive 
30 item displayed on a saeen. 

It is still another object of this invention to provide a 
pointing system of the type described, which is capable of 
informing an operator (rf a species of a selected interactive 
item. 

It is yet another object of this invention to provide a 
pointing system of the type described, which can matd) a 
movement of the cursor coincide with a movement of a 
pointing unit or a movable stage. 

According to an aspect of this invention, a method is for 
use in indicating a coordinate position on a screen of a 
gr^hical user interface in an interactive system. The method 
comprises the steps of displaying visible items on the screen, 
locating a cursor movable on the screen, detecting a position 

45 of the cursor as the coordinate position in relation to the 
visible items, preparing a tactile sensor, and driving the 
tactile sensor in dependency upon a position relationship 
between the positioo of the curscff and at least one of the 
visible items to notify the position relationship. 

50 According to another aspect of this invention, a pointing 
system is for use in an interactive system to indicate a 
coordinate position on a screen of a graphical user interface 
by moving a cursor on the screen. TTic pointing system 
comprises a display panel which has a screen, for displaying 

55 visible items on the screen, a position detecting unit for 
detecting a position of the curses' in relation to the visible 
items as the coordinate position to produce a position signal 
representative of the position, a relation detecting circuit for 
detecting a relationship between the position of the cursor 

60 and at least one of the: visible items to produce a relationship 
signal representative of a relationship between the position 
and at least one of the visible items and a tactile display unit 
driven by the relationship signal for providing a tactile sense 
determined by die relationsh^ signal. 

65 According to a further aspect of this invention, a pointing 
system comprises a display panel, which has a screen 
defined by a jHcdetcrmincd coordinate, for displaying vis- 
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ible items on the sacen. a coordinate defining unit for don acquisition portion 51 The event monitoring portion 51 

nroviding a unU cowdinate which is in one-to-one coire- monitors a movement of the cursa in response to an event 

9ondence to the predetcnnined coordinate, a pointer unit signal supplied from the CPU 10 to notify the cursor position 

movable on the unit coordinate, and driving means for acquisition potion 52 of the movement of the curs«. On the 

driving the pointer unit along the unit coodinatc. 3 other hand, the cursor position acqmsiuon portion 52 

acquires a current cursor position in a coordinate In response 

BRIEF DESCRimON OF THE DRAWING to notification of the movement of the cursor sent from the 

no. 1 is a block diagram of a pointing system according eventmomtcringportionSLThecoordinateisdefinedintfie 

toaflrstembodimentTttusinvMtion; screen of the bit map display 20. 

no 2 exemplifies an image displayed in a bit map "» Subsequently, the current cwsor position m the coordinate 

display so as^desoibe o;^on of the poinj^g system; i^f-^Sfi^r&'^C^S' 

FIGS. 3(A) and (B) are views fa use m desaibing a screen information deTecting^oS Potion «> 

ttc*ile dispUy used m die pointmg system iUustiated in RG. ^ ia,«active item information acquiSportion 

15 61 and an intoactive item infonnation storage 62. The 

HGS. 4(A) and (B) arc views for use in describing interactive item infcHmation acquisition portion 61 acquires, 

operation of the pointing system shown m FIG. 1; interactive item information which is 

FIG. 5 is a plan view for use in describing a pin display representative of an interactive item present at the cursor 

used as the tactile display; position detected by the cimca- position detector 50. The 

FIG. 6 is a block diagram of a pointing system according 20 interactive item Infonnation is successively stored in tht 

to a second embodiment of this invention; interactive item information storage 62. 

FIG. 7 exenq>lifies an image displayed on a bit map At any rate, the cursor position detector 50 and the screen 

display used in the pointing system Illustrated in information detccting^lding portion 60 are practically 

FIGS. 8(A) and (B) show data formats for use in describ- formed by software, 

ing operation of the pointing system illustrated in FIG. 6; ^5 Referring to FIGS. 2, 3(A) and 3(B). 4(A) and 4(B). and 

and 5 together with FIG. 1. description will be made as regards 

FIG. 9 is a block diagram of a pointing system according operation of the pointing system illustrated in FIG. 1. At 

to a modification of the second embodiment iUustrated in first, the bit map display 20 iUustraled in HG. 2 is prepared 

pjQ ^ as the gr^)hical user interface and has a saeen. In FIG. 2, 

^ it is assumed that a window 200 is displayed on the screen 

DESCRIFTION OF THE PREFERRED display 20 as one of interactive items along 

EMBODIMENTS with the cursor depleted at 210. 

Referring to HG. 1. a pointing system according to a first As shown in FIG. 3(A). a pin dii^lay 91 is prepared as the 

embodiment of this invention is practicaUyiniplemented by tactUe display 90 and has a plurality of pins which are 

an information processing system- In this connection, the arranged in seven rows ann seven colunms (7x7) and which 

illustrated pointing system con^scs a central processing are individuaUy movable q)wards of FIG. 3(A). Such pins 

unit (CPU) 10. a bit map display 20, and a data input device can give tactile senses to an opcralw when they are projected 

30 The hit m^ display 20 defines a screen on which a upwards. As illustrated in FIG. 3(B), the pin display 91 

cursor and visible or interactive items are displayed. illustrated in FIG. 3(A) is located on a tout* panel 101 

The central processing unit (CPU) 10, the bit map display which is prepared as the position detector 100 (FIG. 1). 

20 and the data input device 30 form a graphical user With this structure, not only the posiUon of die cursor 210 

interface of an interactive type. but also image information adjacent to the cursor 210 can be 

In addition, a cursor position detector 50, a saeen infor- i^^^^^^^^^^.^^^^'^P^^^ 
mationdetectingAioldinVportion 60. an output information 45 ^iven^ the pins W. In other wa^ 

SJodudng portion 70. a tartUe display contre.Ucr 80. and a both the cursor 210 and an mteracuve item or items adjacent 

SSle^'pCiS^ Ld a position lJcU>r 100 are included lo the cu«or 210 on the pin dispUy 91 over a^cdet™^ 

S Ae iUustiated pointinrsystcm. SpedficaUy, tiie cursor region. Therefore, an operator can detert a distance bOwecn 

ITtfoo^^^^ 210 and tiie interactive item or items without 
moS^rSfbitmapdisp^ 50 observing or watching the saeen of the bu map ^^^^^ 

tion detectingmolding portion 60 is connw^ to the curscr AUemativcly, the pin display 91 may be. for cxan^le. of 

position detector 50 and serves to extract visual information a type of mechanicaUy vibrating jaas arranged m a matrix, 

of interactive items from a region located in the vicinity of At any rate, tiie pin display 91 is placed on the touch panel 

the cursor currcntiy displayed on the bit map dispUy 20. The 101 in the manner illustrated in HG. 3(B). In this case, the 
output information producing portion 70 is operable to 55 curscr 210 is partially overlapped at an upper right part with 

convert tiic visual infonnation into a data signal sequence tiie window 200 on the screen of tiie bU map display 20. as 

which can be displayed by the tactile diqilay 90 and whidi shown in FIG. 2. 

will be called a tactile signal sequence. Supplied witii tiie Herein, the touch panel 101 defines a coordinate system 

tactUe signal sequence, tiie tactile display controllci 80 of the fan display 91. In tiic example being illustrated, tiic 
produces a control signal CS related to the tactile signal ^ coordinate or a coordinate system of tiic pin display 91 may 

sequence to control tiie tactile display 90. be relatively defined relative to a coordinate system of ttic 

The tactile display 90 is operable to provide a tactile sense screen formed on ttie bit map display 20. This means tiiat 

in accordance witii tiie control signal CS in a manner to be each position of tiie |an display 91 on tiie touch panel 101 

described later. A position or location of tiie toctile display may not always be in one-to-one correspondence to each 
90 is detected by tiie position detector 100. 65 position of tiie screen on tiie bit map display 20. 

In tiie iUustrated example, tiie cursor position detector 50 In tfus situation, when tiie operator moves ttic pin display 

includes an event monitoring portion 51 and a aasor posi- 91 on ttie toudi panel 101. pin coordinate values on tiie 
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toudi pand 101 are transmitted as coonUnatc positions boundary of the interactive item zone and renders the 
through ttic position detector 100 to the CPU 10 to sptdfy remaining zone into zero, as Ulustratcd in FIG. 4(B). The 
a position of the pin display 91 on the toudi pand 101. On above-mentioned operation can readily be earned out in a 
the otha hand, the CPU 10 delects cursor coordinate values known mannff. At any rate, the output information poiuon 
representative of a position of the cursor 210 on Ac sCTeen 5 70 supplies the tactile disjHay controUcr 80 with a tactile 
of the bit map display 20. display state signal ^xpcaring as a rcsuU of the abovc- 
The CPU 10 substitutes the pin coordinate values for the mentioned operation. The tactile display state signal is 
cursor coordinate values and issues the event signal repre- representative of a rdationshq) between the position of the 
sentativc of occurrence of a movement of the cursor 210. cutsch- 210 and cadi of the intcr-activc items and may be 
Thus, die cursor coordinate values are renewed An response called a rdationship signal mdicative of the above- 
to the ran coordinate values. The event signal is delivered to mentioned rdaUonship. In fius connection, a combination of 
me event monitoring portion 51 of the cursor position the screen information detectingrtiolding portion 60 and the 
detector 50 TTius, a combination of the CPU 10 and the output inf^mation producing portion 70 will be referred to 
cursor position detector 50 saves to detect the position of as a relation detecting unit for detecting the above rdation- 
thc cursor 210 on the screen of the bit map display 20 and ship. 

may be caUed a posiUon detecting unit Responsive to the tactile display state signal, die tactile 

The event monitoring portion 51 always monitors the display controller 80 produces &e confr^^ 

event signal issued from O^VctU 10. Whe/the event signal project the pms on ^hetac^e display ,f,P^^<« ^!"^ 

is detected by the event monitoring portion 51. detection of corresponds to the identifica^on number 1000 . In oUie^ 

L event si^l is transmitted to liZso. posiUon acqui- ^ words, the pins of the UOde di^lay 90 are not projected at 

Stion porti^2. On die detection of the evVnt signal the ^ Positions specified by the identificauon number of zero. 

cursor>osition acquisition portion 52 is given a current As a result, six of the pins 92 arc projccled upwards on the 

position of the cursor 210 whidi is sent to the sacen pin display 91, as shown by fee bladccirdes in FIG. 5. Thus, 

information detectingAiolding portion 60. a combination of the tactile display controUer 80 and die 

In die screen information detectingAiolding portion 60, „ tactile display 90 may be referred to as a tactile display umt 

the interactive item information acquisition p^tiwi 61 is ^ Thcrcf<^ the operator can recognize the mteracUvc item 

a)crated in response to the current position of the cursor 210 is present at die upper right pcHtion of die tactile display 90 

and die interactive item information given from die CPU 10. witiiout watching &c screen on die bit map display 20. 

SpcdficaUy, die interactive item information may be repre- The operator moves the tactile display 90 on the touch 

scnted by an identification numberviiidi is assigned to each 3^ pand 101 in response to the tactile sense. As a result a 

interactive item that resides within die iwedctennined region movement result signal is produced from the touch pand 

determined by the pin display 91. As illustrated in FIG. 3. die 101 and is fed back to die position detector 100. Therefore, 

pin display 91 has a center point coincident to die position the pin display 91 and die touch pand 101 may be coUec- 

<rf die cursor 210 and defines the predetermined region tively called die tactile display 90. 

formed by seven rows and seven columns (7x7) around die 3^ Referring to FIG. 6 together witti FIG. 7. a pointing 

center point, as mentioned bef(H^e. This shows diat die system according to a second anbodiment of diis invention 

predetermined region is defined by forty-nine dots of die comprises similar parts designated by like reference numcr- 

pins. als. In FIG. 6. the pointing system serves to inform an 

The illustrated interactive item information acquisition operator of a position of a cursor 210 (FIG. 7) in relation to 

portion 61 of die screen information detecting/holding por- 40 interactive items, such as a window 200 (HG. 7), by die use 

tion 60 obtains or acquires, from the CPU 10. die identifi- of an inner force sense and a movable stage or unit 110 in 

cation numbers dispersed widiin Uie predetermined region a manner to be described later in dctaU. The movable stage 

defined by the forty-nine dots. The identification numbers of 110 will be refcued to as a pointer unit 

the forty-nine dots are successivdy stored widiin die inter- More specifically, the illustrated pointing system indudcs 

active item information storage 62. After die identification 45 die CPU 10. the bit map diq)lay 20 (HG. 7). die data input 

numbers of forty-nine dots are all stored in the interactive device 30, die cursor position detector 50, and the saecn 

item information storage 62, tiiey arc sent from die interac- information detecting/holding portion 60 like in FIG. 1. The 

tive item information acquisition portion 61 to the output cursor position detector 50 and the screen information 

information producing portion 70. detecting/holding portion 60 may be similar to diosc illus- 

Pot example, it is assumed diat an identification number 50 trated in FIG. 1, respectivdy. Therefore, die cursOT position 

of 1000 is assigned to die window 200 shown in FIG. 2 and detector SO is composed of the event monitoring portion 5 1 

diat no existence of any interactive item be spcdfied by 0. and die cursor position acquisition portion 52 while die 

As shown in FIG. 2, when die pred<^ermincd region defined screen information detecting/holding portiOT 60 is com- 

by die tactile display 90 is partially overl^jped widi die posed of die interactive item information acquisition portion 

window 200 at a right upper portion of die tactile display 90, 33 61 and die interactive item information storage 62. 

die identification numbers "1000** are gadicrcd in die form In addition, die movable stage 110 may be, for example, 

of an interactive item zone at a right uj^ part of the apen whidi is used In an X-Y plotter and which is movable 

forty-nine dots with the remaining part filled widi 0, as along a predetermined area deleted at 111 in FIG. 6. The 

exemplified by a number pattan in FIG. 4(A). predetermined area may have a rectangular shape which is 

Herein, let the ouqxit information producing portion 70 eo defined by an X-axis and Y-axis. Practically, die prcdcter- 

detcct a boundary an edge of die interactive item zone to mined area is given by a pand as shown in FIG. 3(B) and 

produce an output signal whidi is representative of the is in one-to-one correspondence to die screen defined on die 

boundary of die interactive item zone and which serves to bit map display 30. In diis connection, it is to be noted diat 

project die pins corre^nding to die boundary of die die predetermined area defines an absolute coordinate sys- 

interactive item zone. 63 tcm which may be called a unit coordinate system. 

To diis end, die output information producing pcstion 70 In order to detect a position of die movable stage 110 on 
keeps die identification numbers "IGOQ- arranged on die die absohite coordinate system, a cowdinate position calcu- 
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lator 120 is electiicaUy connected to the movable stagt 110 cuircnt coonlinate position are stored in the Interactive item 

to suDiilv the CPU 10 with a coordinate position signal infonnatioB storage 62. In this situation, when processing is 

rep«senLive of the position on the absotate coonlinate finished in connecUon wift thefiye dots m a« ';j^vc 

it^«,;>vui«u V i~ Monnation acquisibon pomoa 61. the idcntmcatioD 

. , ^ ^, iiA. ^ numbffsof the five acts arc sent to the display infonnation 

A drive unit 130 is cou;^ed to the movable stage 110 to ^^y^ 150 as the intexactive item infonnation. 

drive the movable stage UO along the absolute coonhnate Rcfcning to HGS. 8(A) and 8(B) along with HG. 7, a 

system defined wifliin the prcdctcnnined area. The ilius- sequence is exeniplified which is stored as the idcnti- 

trated drive unit 130 includes an X driver 131 for drivmg the fication numbers in the interactive item information storage 

movable stage 110 in a direction of the X-axis and a Y driver on the assunqrtion tfiat &e cursor 210 is located at the 

132 for driving the movable stage 110 in a direction of the Icfthand side within the window 200. as shown 

Y-axis. Moreover, the drive unit 130 further includes an X pjQ 7 ^nd that the identification number of 1000 is 

braking unit 133 for braking movement of the movable stage assigned to the window 200, 

110 in the X-axis direction and a Y braking unit 134 for Under the circumstances, the data sequence is conqwsed 

braking an <^>eration or a movement of the movable stage 3 single row and five columns allocated to the current 

110 in the Y-axis direction. coordinate position and the four dots placed at the upper, the 

A movable stage contrtriler 140 is coupled to the X driver lower, the Icfihand, and the righthand sides, req)ectively. as 

131, the Y driver 132. the X braking unit 133, and the Y shown in FIG. 8(A). 

braking unit 134 to dcUver a sequence of conunands to them Since the cursor 210 is located at the edge of fee lefthand 

and to control the movement of Ae movable stage 110. The _ side within the window 200 in the iUustrated exan^)le, Ac 

movable stage controUer 140 is connected to a dispUy ^ identification number of 1000 is loaded wth the columns 

information analyzer 150 which analyzes cuirent states of ^^c cursor position, Ac upper side. Ac lowff ade jmd ttie 

the cursor 210 rented to the interactive items, such as the Righthand side except the column for the l^^^l"^^^ 

luc tuiaui *iv , A^c^T^ is because no interacuve Ucm is present on the Icfthand side 

wmdow 200 in a mamier to be described. j^e current cursor position, in this example. 

In the iUustratcd cxan^le. it is assumed that the mnff ^ ^ ^ sequence shown in FIG. 8(A) is sent 

force sense is given to the operator by the X and the Y from the intaacUve item infonnation acquisition portion 61 

braking units 133 and 134 when the cursw 210 readies an ^^^^ information analyzer 150. The display infw- 

edge of each interactive item displayed on the bit map niation analyzer 150 processes the data sequence into a 

display 20. Specifically, let the cursor 210 be located at a processed data sequence divided into five columns for the 

lefthand side edge of the window 200 which may be ^ ^y^^ position, the upper side, the lower side, the lefthand 

considered as one of the intaactive items, as illustrated in ^nd the righthand side, as illustrated in FIG. 8(B). 

FIG. 7. Under the circumstances, when the operator moves Herein, the display Information analyzer 150 calculates 

the movable stage 110 (FIG. 6). the coordinate position absolute values of differences between the identification 

calculator 120 detects the position of the movable stage 110 number of the cursor position and fee other identification 

on the absolute coordinate system and calculates in absolute numbers of the uj^ier. the lower, the lefthand. and the 

coordinate position of the cursor 210 on the screen of the bit righthand sides. As. a resuh. the identification number of 

map display 20 from the position of the movable stage 110. 1000 is kq)t at the columns for the cursor position and the 

As a result, the coordinate position calculator 120 siqiplies lefthand side with the rcnoaining columns kept at 0, as shown 

the CPU 10 with an absolute position-signal representative in FIG. 8(B), 

<rf the absolute coordinate position of the cursor 210. The ^ gy^j^ 3 processed data sequence is sent firom the display 

CPU 10 moves the cursor 210 in response to the absolute information analyzer 150 to the movable stage controller 

position signal to the absolute position indicated by fee 140. The display information analyzer 150 selectively drives 

movable stage 110 on one hand and supplies fee event ^ driver 131. fee Y driver 132, fee X braking unit 133. 

monitoring potion 51 wife fee event signal on fee ofeer y braking unit 134 response to fee processed data 

hand. 45 sequence, as shown in FIG. 8(B). For example, fee movable 

When fee event signal is received, the event monitoring stage controller 140 drives fee X braking unit 133 only when 

portion 51 notifies fee cursor position acquisition portion 52 eifeer one of fee colunms for fee lefthand and fee righthand 

of reception of fee event signal. Notification of fee event sides In fee processed data sequence keeps non-zero. On fee 

signal allows fee cursor position acquisition portion 52 to other hand, the movable stage controller 140 drives fee Y 

receive a current coordinate position of fee cursor 210 fi-om ^ braking unit 134 only when eifeer one of fee columns for fee 

fee CPU 10 and to supi^y fee screen information detecting^ upper and fee lower sides in fee processed data sequence 

holding portion 60 wife a current coordinate position signal keeps non-zero. This means that fee X braking unit 133 is 

indicative of fee cucrent coordinate position of fee cursor operable to suppress fee movement of fee cursor 210, 

210. namely, fee movable stage 110 along fee X-axis when no 

In fee screen information detecting/holding portion 60. 33 interactive item is present along fee columns for the lefthand 

fee interactive item information acquisition portion 61 is and fee ri^thand sides of fee processed data sequence, 

given the current coordinate position of fee cursor 210 from Likewise, fee Y braking unit 134 is operable to suppress fee 

fee CPU 10. The cuirent coordinate position of fee cursor movement of fee cursor 210 along fee Y axis. 

210 is assumed to be given in fee fom of a dot. In this event In FIG. 8(B), fee absolute value of 1000 assigned to fee 

fee CPU 10 supplies fee interactive item information acqui- go column for the leffeand side of fee processed dau sequence, 

sition pOTtion 61 wife identification number assigned to fee Therefore, fee X braking unit 133 is driven by the movable 

cmrent coordinate position togefecr wife identification num- stage contrdlcr 140 to suppress fee movement of fee mov- 

bcrs assigned to four dots assigned to uppa and lower sides able stage 110 along fee X axis, ftom this fact it is readily 

and righfeand and leffeand sides of fee cuirent coordinate understood that fee operato- can recognize fee edge or 

position of fee cursor 210. 65 boundary of fee interactive item, namely, fee window 200 

All of fee identification numbers assigned to fee current wifeout watching or observing fee screen of fee bit map 

coordinate position and to fee four dots adjacent to fee display 
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Although the X and the Y tvakiog units 133 and 134 are 
used in ttit illustrated exan^e, any otha braking naay be 
used in the pointing system- For example, weak braking 
fMcc may be imposed on the movable stage 110 as com- 
pared with braking f oarce of the X and the Y leaking units 
133 and 134. At the boundary of each interactive ttem, the 
movable stage 110 may be given a sense of instantaneously 
stopping the movable stage 110. Any other methods may be 
^lled to give an iimer force sense. 

In addition, an inner force sense may be fed back to the 
movable stage 110 not only at the boundary of cadi inter- 
active item but also at a center position of each interactive 
item. Flnthermore. it is possible in FIG. 7 to jMohibit the 
cursor from being introduced into the window by forcibly 
moving the movable stage 110 leftwards. 

Referring to FIG. 9, a pointing system according to a 
modification of the second embodiment illustrated in FIG. 6 
is similar in structure and operation to that illustrated in FIG. 
6 except that an input unit 160 is include a In Ae pointing 
system illustrated in FIG. 9. The illustrated input unit 160 
serves to move the movable stage 110 in a direction indi- 
cated by an operator. More specifically, the input unit 160 is 
operated on moving the cursor 210 in a hCHizontal direction 
or a vertical one straightforwards. In this event, the operator 
instructs or indicates to move the cursor by the use of the 
input unit 160 in the horizontal or the vertical direction 
straightforwards before the movable stage 110 is driven. 
When the instruction is received by the movable stage 
controller 140, the movable stage controller 140 issues an 
indication only to the X driver 131 to prohibit the movable 
stage 110 from being moved in the vertical direction when 
the horizontal movement instructed. This is because the Y 
driver 132 is not driven by the naovablc stage controller 140. 

On the other hand, when the instruction indicates the 
vertical movement erf the movable stage 110. the movable 
stage controller 140 controls the driver 130 so that the Y 
driva alone is driven. This movement of the movable stage 
110 is completely matched witfi a movement of a hand of the 
operator. 

With this structure, it is possible to automatically move a 
coordinate position indicated by the operator by using the X 
driver 131 and the Y driver 132. 

At any rate, an interactive item adjacent to the cursor can 
be recognized by a tactile sense. This is very belpfiil to 
lighten a bin^den imposed on a sense of sight of an opexatcx. 
especially, a handicapped person who has a handicap in a 
sense of sig^t 

Whfle this invention has thus far been described in 
conjunction witfi a few embodiments thereof, it will rcadUy 
be possible for those skilled in the art to put this invention 
into practice in various odier maimers. For example, the 
movable stage 110 illustrated in FIGS. 6 and 9 may be 
replaced by the pin display 91 illustrated in FIG. 1. On the 50 
other hand, the movable stage 110 may be used in FIGS. 6 
and 9 instead of the pin display 91. In addition, various types 
of pointer units may be used as the tactile display 90 or the 
movable stage 110 to provide the tactile sense and/or the 
inner force sense. 

At any rate, intaactive item information may be cxtrartcd 
from the cursor position and a plurality of positions placed 
around the cursor position so as to specify a relationsh^) 
among the interactive information. In addition, different 
identification numbers may be assigned to different interac- 
tive items and may be distinguished by different tactile 
senses or inner force senses. 

What Is claimed is: 

1. A method of indicating a coordinate position on a 
screen of a graphical user interface in an interactive system 
by displaying visible items on said screen together with a ^ 
cursor movable on said screen, said method conqsrising the 
steps of: 
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detecting a position <rf the cursor as said coordinate 
position in relation to said visible items; 

preparing a tactile sensor which is put into an active state 
to provide a tactile sense to a user for notifying when 
the cursor is close to at least one of the visible items: 
and 

stinuilating a tactile element located on a surface <^ said 
tactile sensor, in dependency upon a positional rela- 
tionsh^) between the position of the cursor and at least 
one of the visible items to notify the user of the 
positional rela£ionshq>. 

2. A pointing system for use in an interactive system to 
indicate a coordinate position on a screen of a gr^hical user 
interface by moving a cursor on said soecn which displays 
visible itwns together with the cursor, said pointing system 
convulsing: 

a position detecting unit for detecting a position of the 
cursor in relation to the visible items as said coordinate 
position to produce a position signal whidi is repre- 
sentative of the position <^ the cursor; 

a relation detecting circuit for detecting a relationship 
between the position of the cursor and at least one of 
the visible items to produce a relationship signal which 
is representative of a relationship between the position 
and at least one of the visible items wherein said 
relationship signal is produced as the cursor moves 
within a vicinity of at least one of the visible items on 
said screen; and 

a tactile di^lay unit driven by said rdationdiip signal for 
providing a tactile sense to a user determined by said 
relationship signal. 

3. A pointing system as claimed in claim 2. wherein said 
tactile display unit comprises: 

control unit si]^lied with said relationship signal for 
producing a control signal in relation to said relation- 
ship signal; 

a tactile display driven by said control signal for provid- 
ing said tactile sense determined by the control signal 
to move the tactile sense determined by the a move- 
ment result signal representative of movement of said 
tactile display; and 

feedback means for said movement result signal to said 
position detecting imit to contrd the position of the 
cursor in response to ttie movement result signal 

4. A pointing system for use in an interactive system to 
indicate a coordinate position on a screen of a graphical user 
interface by moving a cursor on said saecn whidi displays 
visible items together with the cursor, said pointing system 
con^Hising: 

a position detecting unit for d^ecting a position of the 
cursor as a cursor position in relation to the visible 
items as said coordinate positicHi to produce a position 
signal which is rqH^esentativc the cursor position; 

a relation detecting unit for detecting a relationsh^ 
between the cursor position and a position of at least 
one of the visible items within a predetermined range of 
the cursor position to produce a relationship signal 
which is representative of the relationship; and 

a varying luut for varying at least one of a tactile sense and 
an inner force sense determined by said relationship 
signal for notifying a user of the relationship. 
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